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In a previous paper, a model for the behavior of a switching node 
that receives data from many terminals over low-speed access lines was 
considered. In this paper, we give the details of an alternate procedure 
for calculating the steady-state probabilities for the buffer content. It 
is shown that a finite system of linear equations may be obtained for 
calculating the steady-state probability that the buffer content is i. In 
a particular case of interest, explicit formulas are derived for the 
number of equations which arise in this procedure, for each value of i. 
Some detailed calculations are given for one example. 

I. INTRODUCTION 

Mathematical models for the behavior of a switching node that re- 
ceives data from a (large) number of terminals over low-speed access lines 
have been considered by Gopinath and Morrison, 1 - 2 and some particular 
examples have been investigated by Fraser, Gopinath, and Morrison. 3 
In this paper, we consider one of the models and give the details of an 
alternate procedure, which was alluded to by Gopinath and Morrison, 1 
for calculating certain steady-state probabilities. 

We first describe the model which we will consider. It is assumed that 
the data are received at the switching node in the form of packets of fixed 
size. As the packets arrive, they are placed in a buffer, which is a first- 
in-first-out queue. The buffer processes packets at a uniform rate, pro- 
vided that it is not empty. In an actual computer network, the buffer 
capacity is finite, and a packet is lost if the buffer is full when it attempts 
to enter it. In our mathematical model, it is assumed that the buffer has 
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infinite capacity, so that no overflow is possible, and we are interested 
in calculating the steady-state probability that the buffer content (i.e., 
the number of packets in the buffer) exceeds the proposed capacity of 
the buffer. 

We let the time that it takes for the buffer to process a packet through 
the node be our unit of time. We suppose that £„ is the number of packets 
which enter the buffer in the time interval (n,n + 1]. If b n denotes the 
buffer content at time n, then the buffer content at time n + 1 is given 
by the equation 

b n+1 =(b n -l) + + U, (1) 

where a+ = max(a,0). The quantity £„ is a random variable, and hence 

so is b n . 

Consider the case in which each message from a terminal consists of 
exactly two packets which are separated by k units of time, where k is 
an integer. The packets are spread apart since the speed of the access 
lines is slower than the buffer processing rate. If x n denotes the number 
of first packets entering the buffer in the interval (n,n + 1], then £„ = 
x„ + x n - k , since x n -k is the number of second packets entering in this 
interval which belong to messages whose first packets entered k intervals 
earlier. It was shown, 1,3 under suitable conditions, that if the number 
of terminals is large, then it is a reasonable approximation to assume that 
the random variables x, are independently and identically distributed 

(i.i.d.). 

A generalization of the above model was considered, 1 in which the 
number of packets entering the buffer in the interval (n,n + 1] is 

£n = £ OtjXn-j, (2) 

where the nonnegative integer valued random variables x, are i.i.d. and 
the constant coefficients a; are nonnegative integers. It is assumed, 
without loss of generality, that oc y*0^<x k . This is the model which we 
consider in this paper. It corresponds to a fixed pattern for each message. 
A more general model was considered 2 which allows for randomness in 
the message pattern, e.g., a random number of packets in a message. It 
would be of interest to obtain results for the more general model, anal- 
ogous to those derived in this paper for the model corresponding to (2). 
This could be the topic of a future paper. 

The results are stated and proved in a series of propositions, lemmas, 
theorems, and corollaries. In Section II, an explicit expression is first 
given for the steady-state probability that the buffer is empty, under 
the assumption that the mean arrival rate is less than unity. The 
steady-state probability that the buffer content is i is expressed in terms 
of the steady-state probabilities corresponding to a certain (k + 1)- 
dimensional Markov process. Criteria for the proper states of this process 
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are obtained, and it is shown that, for fixed k, a finite number of these 
states correspond to a prescribed buffer content. The fundamental 
relation satisfied by the steady-state probabilities corresponding to the 
(/? + l)-dimensional process is derived. 

In Section III, it is shown how this fundamental relation may be it- 
erated, so as to obtain a finite system of linear equations for calculating 
the steady-state probabilities corresponding to a prescribed buffer 
content. Numerous subsidiary quantities are defined to establish the 
required reduction formulas. The use of the reduction formulas to obtain 
the desired steady-state probabilities is described in Section IV. 

In Section V, attention is turned to the particular case £„ ■ x n + x n -k> 
so that 0-0=1= otk, and atj = otherwise, in (2). Explicit formulas are 
derived for the number of equations which occur in the calculation of 
the steady-state probabilities corresponding to a prescribed buffer 
content. In Section VI, the steady-state probabilities corresponding to 
an empty buffer are calculated in the case k = 4. 



II. THE FUNDAMENTAL RELATION 

We assume that the mean arrival rate at the buffer is less than unity, 
and we are interested in determining the quantities 

Ki = lim Pr(6„ = 0, (3) 

where b n satisfies (1) subject to (2). Hence, k, is the steady-state prob- 
ability that the buffer content is i. We will see that the determination 
of these quantities involves the determination of certain other steady- 
state probabilities, as discussed by Gopinath and Morrison. 1 It was 
proved 2 that all these steady-state probabilities exist. We proceed to 
state, and prove, the results in a series of propositions, lemmas, theorems, 
and corollaries. We first give an explicit expression 1 for k , the steady- 
state probability that the buffer is empty. 

Proposition 1:kq- 1 - HkE(x) where n k = £? =0 «,- andE(x) is the ex- 
pectation of any x n . 

(This result may be derived by solving (77) in Ref. 2 for the marginal 
generating function 0*(s), and letting s -* 1. This was the method of 
proof used in Ref. 1.) 

We remark that, from (2), £(£„ ) = ii k E{x). Note that our assumption 
that the mean arrival rate is less than unity implies that k > 0. 

To determine the other k, 's, it will be convenient to use the following 
quantities: 

0n ] = £ ^iXn+r-i-l for T = 1, . . . ,k. (4) 

i=r 

Since we are using the first packets of a message to count the number 
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of intermediate packets at some later time, the 6 { n r) correspond in this 
sense to the packet contribution prior to time n to £„+ r -i. We will de- 
termine the Ki's by exploiting the recursive relations between b n , £„, and 

OP. 

Let Z 1 be the direct sum of a countable number of copies of Z, the set 

of integers. For /, a nonnegative integer, we define the following collection 

of subsets: 

N'= \(n , . . . ,ni,0, . . .)\n , . . . ,ni > 0). 

Clearly, we have A^C^O • • CZ 1 '. We now define a random k + 
1 -tuple variable 

B n =(6 n ,fli 1, ,...,e , ,0,...). (5) 

Using B„, we can define a map U that sends Z 1 into [0,1]. Given me Z 1 , 
with m = (mo,mi, . . .), we define 

U{m) = lim Pr(B n = m). (6) 

n — ►<*> 

We can then recover any *,- from the L/(m)'s via the relation 

Ki = ZU(m). (V) 

mo=i 

This summation looks unwieldy, but we will show that this is not the 

case. 

We first establish 

Proposition 2: (6„_, - 1) + + L/=i Zn-i < b n + I - 1 for I > I. 

Proof: Use induction on /. 

(/ = 1) (b n -i ~ D + + ^n-i = K, from (1). 

(/ -* I + 1) Note that (b n -i - 1) < (b n -i - 1) + , and hence, using 

(1), 

(b n _,_, - 1)+ + Z $n-i = bn-l + E Zn-i 

1=1 '=1 

< (b n -, - 1)+ + 1 + Z Zn-i <b n + l„ 

1=1 
(The double asterisk is used throughout the paper to denote the end of 
a proof.) 

We now prove 

Theorem 3: U(m) ^ implies that meiV*, a k divides m k and, for 
I = 1, . . . ,k, . 

Z m k - i+ i < Z "o 1 ak-i+j{mo+j - 1). 
i=l y=l 

Proof: To have a nonzero probability that B„ = m, it is immediate that 
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meN k . Also, d ( n k) = a k x n - } = m k , and for a nonzero probability, x n - x 
must take on an integer value. 

Using Proposition 2, we have for / = 1, . . . ,k, 



6„ + / - 1 > £ Sn-i =EI ajXn-i-j > « E x n ., 

i=l i=lj=Q ,=i 



Therefore, 



Now 



/ 

£ * n -i < CV J (6n + / - 1). (8) 



'=1 i'=l j=k-i+l 

k I 

E E ajX n +k-i-j. 

j=k-i+i i=k+i-j 

Hence, if we make the substitutions j = r + k — I and i = a + I — r, we 
obtain 

ie ,+i, = E« r+ H(ixj 

'=1 7"=1 \a=l / 

/ 

^ E « ' « T +ft-/(6n + 7" ~ 1), 

using (8). 

So, if 6 ( n' = m r and b n = m , the m r 's must satisfy these conditions. », 

Corollary 4: For fixed m Q and k, there can only be a finite number of m 
such that U(m) ^ 0. 

Such m that satisfy the criteria of Theorem 3 will be called proper 
states. From (7), each *, then is the sum over only a finite number of 
these. 

To derive the fundamental relation satisfied by U(m) we need 

Proposition 5: 0$, = a r x n + n "- +1 > for r - 1, . . . ,k - 1 and 0^ = 

OCkX n - 

Proof: From (4), for r = 1, ...,/?- 1, 

Wl " E «|Xn+r-i 
i = r 

k 

= « r j:„ + E a t x„+H-i-/-i 
i-r+l 

= a r *„ + 6J[ +1 \ 
and fljjjj = a k x n by definition. „ 

We now define a map from Z 7 into itself called T y , where 7 is a non- 
negative integer: 

T y (m) = R(m) + (7, - (7 - D+,0, . . .), 
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where R is the right shift operator. More explicitly, we can write 

T 7 (m) = (y,m -(y-l) + ,m u . . .). (9) 

Theorem 6: 

U(m) = p(a) L 7 >o U{T y (m - av )), 

where a = aj~Wp(ff) = Pr(x n = o) and v = («o,j • • ,<*hA ■ ■ •)• 
Proof: By Proposition 5, e\Si = m k implies x n = a k l m k = a.lfa is not 
a nonnegative integer, then p(a) = and U(m) = 0, from (5) and (6), and 
the equation holds trivially. 

Now we let a be a nonnegative integer. Recall from Proposition 5 again 

that 

0< r+1) = 0J> r ]i-«r*n, forr = l,...,fe-l. 
Also, from (1), (2) and (4), we have 

l n l) = %n - «o*n = b n+ i - (b n - 1) + - aoX n . 
So, if b n = 7 and B n+ i = (m , . . . ,m fc ,0, . . .), it will be necessary and 
sufficient, from (5), that x n = a and 

B n = (y.rriQ - (y - 1) + - ao<r,mi - a x a, . . . ,m k -\ - a k -i<r,0, . . .). 
In more compact notation, for meN k we have B n+ i = m, b n = y iff B„ 

= T 7 (m - ov ), x n = a. 

But x n is independent of b n and hence, from (4) and (5), of B n . 

Therefore, 

Pr(B„+i = m) = £ Pr(B n+1 = m,b n =y) 

7>0 

= Pr(x n = a) L Pr(B n = T 7 (m - av )). 

7>0 

The theorem follows by letting n — °° and using (6). „ 

The fundamental relation in Theorem 6 satisifed by U(m) was stated 
by Gopinath and Morrison, 1 in less compact notation. They also 
showed 1 - 2 that, once the steady-state probabilities U{m) with m = 0, 
corresponding to an empty buffer, were obtained, then the steady-state 
generating function for the buffer content could be calculated in terms 
of the generating functions for some marginal distributions. In this paper, 
we show how the quantities U{m) may be calculated for any value of m , 
so that the steady-state probability that the buffer content is i may be 
calculated with the help of (7). In fact, we show how to iterate the fun- 
damental relation in Theorem 6 so as to obtain a finite system of linear 
equations for calculating U(m) for a fixed value of m . This procedure 
was alluded to by Gopinath and Morrison 1 in the case m = 0. 

III. REDUCTION FORMULAS 

We first remark that, if m k = then the summation in the funda- 
mental relation for L/(m) in Theorem 6 includes the term corresponding 
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to 7 = mo + 1, so that this does not give a closed system of equations for 
U(m) for a given value of m . To carry out the desired iteration of the 
fundamental relation, it is convenient to define some new quantities. 
Accordingly, we let 

t/<"(m)= £ U(T y (m)), (10) 

7 >0 

and, for r = 1, . . . ,k — 1, define 

£/< r+1 »(m) = £ U^(T y (m)). (11) 

Note that the summation starts at 7 = in (10), but at 7 = 1 in (11). In 
terms of the definition in (10), Theorem 6 may be restated as 

Theorem 6': 

U(m) = p(a)U™(m - av ), 

where a = aJE" l m*, p{a) = Pr(x n = a) and vq = (ct , . . . ,ak,0, . . .). 

The U {r), s are intimately related to the IPs, and analogous statements 
can be made about them. 

Theorem 7: U lr) (m) ^ implies, for k > 1 and r = 1, . . . k, that 
me N k ~ r and, for k > 2 and r = 1, . . . ,k - 1, t/iat a k divides m k - r and, 
for / = 1, ... ,k- r, 

1 1 

£ rrik-i-r+i ^ £ « 'aA-/+ ; (m + r + ;* - 1). 
'= 1 ./= 1 

Proof: Use induction on r. 

(r = 1) From (10), U ll) (m) ^ implies that [/(7\(m)) 5* for 
some 7 > 0. By Theorem 3, T y (m)eN k and a k divides (7\(m)H, for 
some 7 > 0. Hence, from (9), me N k ~ 1 and, for k> 2, a k divides rrik-i. 
Using the inequalities in Theorem 3 on T 7 (m), we have 

£ (T 7 (m)),,_, + 1 < E « -V-/ + ,(7 +7 - 1), 
/=i y=i 

for I — 1, ... .ft. This translates into 

/ / 

£ m*-/ ^ £ «6 1 a fc -/+;(7 +j ~ 1), 
(=1 7=1 

for / = 1, . . . ,k - 1, and 

£ m k -, - (7 - 1) + < £ « "'« ; (7 + ; - 1). 

Since (7\(m))i = m - (7 - D + , we must have 7 < m + 1 in order for 
T y (m)eN k . It is necessary that the m,-'s satisfy the above inequalities 
for the largest possible 7, so we let 7 = m + 1. Then 
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Y. ™k-i ^ L a l ctk-i+j(rno+j), 

i=l 7=1 

for I ■ 1, ... ,k - 1, and the other inequality is redundant, being trivial 
for fe = 1, and implied for k > 2 by the inequality for I - k - 1. 

(r _+ r + d We consider r < k - 2, for k > 3. From (11), U^ +l) {m) 
^ implies that WT 7 (m)) ^ for some 7 ^ 1, so that T 7 (m)eiV fe r 
and a* divides (T 7 (m))*_ r . Hence, from (9), rae^-^ 1 and a k divides 
m/j-r-i. Also, for some 7 > 1, 

£ (T T (m))/e_,- r+ , < L «o _1 «fe-/+y(T + r + j - 1), 
i=i ;=l 

for I - 1 fe - r. As before, 7 < m + 1, and for / = 1, . . . k - r -1 we 

obtain the inequalities 

£ m k -i-r ^ E «o' 1 «/e-/+>( m o + r + j"). 
»=i y=i 

As before, the inequality for / ■ k - r is redundant. 

It follows from the above that U (fc_1) (m) 5= implies that me N 1 , for 
fe > 2. Hence, from (11), L/<*>(m) 5= 0, for fc > 2, implies that T y (m)eN l 
for some 7 > 1, so that, from (9), me N°. But we have already shown for 
k = 1 that l/Wdn) 7* implies that me N°. Hence, t/ (/?) (m) =* implies 
that me N° fork > 1. ,. 

Corollary 8: For fixed m Q ,k,r, there is only a finite number of m such 
that U {r) (m) 7* 0. Moreover, each sum that defines each U (r) is fi- 
nite. 

Proof: The first assertion is clear. For the second, we use (10) and (11) 
and the fact that (T 7 (m))i = m - (7 - D- + •* 

Before we derive the relations for U (r) (m) corresponding to Theorem 
6', we need some more definitions. For r = 0, . . . ,k we define 

Hr = t «U < 12) 

j=0 

and, for r = 0, . . . ,k - 1, 

v r = 0»r»«r+l. • • • »«*.0. • • •)• ^ 13 ^ 

We will make use of 

Proposition 9: T 7 has the properties: 

(i) T 7 (m + m0 = T 7 (m) + R(m'). 

(ii) For integers 7 > 1 and y' > 0, 

T 7+7 '(m) = T 7 (m) + (7 , ,-7 / ,0...). 
(Hi) For integers 7 > 1 and a > 0, and r = 1, . . . ,k - 2, 
T y + ailr (m) - ov r = T 7 (m - <rv r +i). 
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Proof: (i) and (ii) follow directly from (9). Also, using (ii), for integers 
7 > 1 and a > 0, we have 

Ty+a^im) - av r = 7\(m) + (an r , - an r ,0, . . .) - av r 

= Ty(m) - ff(0,Mr + «r+l>«r+2> ■ • • ,Oik,0, . . .) 

= T y {m) - R(avr+i) = Ty(m - av r +i). „ 

For k > 2, r = 0, . . . ,k — 2, and a a nonnegative integer, we define 

S r (m;<r) = T ailr (m) - av r . (14) 

Also, for k > 2, r = 1, . . . ,k — 1 and s = 1, . . . ,r, and a^rrik-r a non- 
negative integer, we define V { r s) (m): 

V< s) (m) = £ U^iS^iTy.O. . . 07V,(m Wm fc -r)), 

71 7r-s^l 

if s ^ r, where O denotes composition of the operators, and 

vr(m) = WKSr-iimtffmk-r)). (15) 

Lemma 70: Vj&Gn) = £ 7 >, V r w (T t (m))/br* > 3,r = 1, . . . ,fc - 2 and 
s=l,... ,r, and a* ' (T Y (m))/i_ r a nonnegative integer. 
Proof: We will only consider the case r ^ s. The proof for r = s requires 
only a slight modification. From (15), 

£ W s, (T 7 (m)) 
= £ £ t/<^(S,.- 1 (T 7l o. ..0T 7r _, oT 7 (m) ;< r)), 

7>1 71, . . . ,7r- s >l 

where o- = a* l (7\(m)) fc _ r . However, from (9), (T 7 (m))*_ r = m k - r - X for 
k -r>2. Therefore, a = aJ ; l (Ty(m)) k . r = aJ7 l (m) A _ r _i, and if we let 
7 = Yr+i-.s, then the above expression is equal to Vjj$i(m). », 
Theorem 11: Let k > 2. For r = 1, . . . ,k -l,we have the following for- 
mulas: 

U^(m) = p(a)\u^^)( m - ,j Ur ) + £ V?>( m )l 

where <t = ctk l (m) k - r and a ^ 0. // a = 0, £/ien 

t/W(m) = p(0)[L/«' + "(m) + Vj^dn)]. 
Proof: We use induction on r. 

(r = 1) Note here that the two cases coincide. From (10) and 
Theorem 6', 

t/< 1 »(m)= £ t/(7\(m)) = £ p(a)U™(Ty(m) - <xv ), 

7^0 -)>0 

where a = aT t l (T y(m)) k . But (T y (m)) k = m A _] for ft > 2; therefore, o- 
= c^'m/,-1 and so cr is independent of 7, and 
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C7(»(m) = p(a) E f/ (1) (T 7 (m) - m»o). 

7>0 

If (7 is not a nonnegative integer, then p(<x) = and U {l) (m) = 0, and the 
required result holds trivially. If a is a nonnegative integer, then we let 
(7=7 — <T^o and obtain 

im>(m) = p(ff) E ^ (1) (T q+ „ M0 (m) - auo). 

q>—ona 

The zeroth term of T q+IT ^(m) - <jp q is q, so, by Theorem 7, any terms 
where q < vanish. Hence, 

t/(«(m) = p(<r)\uM(T aM (m) - (jvo) + E t/ (l) (T,+ w (m) - w ) 
L *« J 

= p(c7)ra< 1 HS (m;r7))+ E t/<>>(7ym-™,))| 

= p(a)[V\ 1) (m) + a< 2) (m-(T J / 1 )]. 

The last two steps follow from (11), (14), and (15), and Proposition 9, 
and the fact that a = aj^mk-i, to use the definition of Vl 1 '. 

( r _ r + i) We consider r < k - 2, for k > 3, and first assume that 
a = ak l m k - r -i * 0. But (T 7 (m))*_ r = m k -r-h for r < /? - 2. Hence, 
o- = ak l (Ty{m)) k -r ?* 0, and we may use our inductive hypothesis on 
U {r) (T y (m)). From (11), since a is independent of 7, we obtain 

L/< r+1 >(m)=p(a) £ \ W + »(T y (m) - ai>r) + t V< v) (T 7 (m))l. 

7>1 L s =1 J 

If a ^ is not a positive integer, then p(a) = and L/ (r+1) (m) = 0, and 
the required result holds trivially. 

If a is positive, then, using Lemma 10, we have 

l/"" +1 >(m) = p(cr) \ £ t/<'' +1 >(T 7 (m) - av r ) + £ V#i(m) 1 
L 7 >i s=i J 

Also, if we let q = 7 - ay. r , then 

£ £/< r+1) (7\(m) - ffv r ) = E L/( r+1 >(r q+<rMr (m) - av r ). 

7>1 g>l — fff«r 

But <r and /z r are positive integers, so a/ir £ 1. Hence, by a similar argu- 
ment to the case r — 1, 

E W r+1 KT y (m) - av r ) = E l/ (r+1) (T (/+ffMr (m)-w r ) 

= l/< r+1 >(T ff „ r (m) - ffPr) + E f/ (r+1) (T g (m - av r +i)) 

= VftV>(m) + W +2) (m ~ ffVr+i), 
where we have used (11), (14), and (15), and Proposition 9. Conse- 
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quently, 

where a = a"k m-k-r-i. 

Finally, we consider the case a = 0, so that (T y (m))k- r — rrik-r-i = 
0. Then, using (11) and the inductive hypothesis on U lr) (T y (m)), we 
have 

[/CH-i)( m )- p (0) £ [U<r+V{TjW) + V}P(T y im))] 

= p(0)[L/<'- +2 >(m) + V<Vi(m)], 

from Lemma 10. ,, 

Having derived the reduction formulas of Theorem 11, we now com- 
ment on the quantities V { r s) (m) defined in (15), under the assumption 
that aj: ] mi { - r is a nonnegative integer. It may be verified, from the def- 
initions in (9), (13), and (14), that, for k > 2 and r = 1, ... , 
k - l,S r -i(m;aj; l m k -r)e N k ~ r implies that meN h - r . Also, for h > 3, 
r = 2, . . . ,k - l,s = 1, . . . ,r - 1, and positive integers 71, . . . ,y r -s, 
S„.-,(T 71 0. . .OT 7r _ s (m); «^m fc _ r )eN*- s implies that meN'<- r . 
It follows, from Theorem 7, that, for k > 2, r - 1, . . . Ji - 1 and s - 
1, . . . ,r, V< s) (m) ^ implies that m£N k ~ r . Also, for r = 0, . . . ,/z - 1, 
we note that (m — <nv)e N k ~ r ~ ] , where a = a^mk-r is a nonnegative 
integer, implies that me N*~ r . 

IV. THE STEADY-STATE PROBABILITIES 

We define the sets 

12, = |£/(m)|0 < m () < /, m a proper state), (16) 

where the proper states satisy the criteria of Theorem 3. The sets ft, are 
finite, for fixed k, by Corollary 4. We will first show how to calculate the 
elements of fto- Then, as shown by Gopinath and Morrison, 1,2 the 
steady-state generating function for the buffer content can be calculated 
in terms of the generating functions for some marginal distributions. The 
marginals are finitely solvable, in the sense that a finite number of 
components of the marginal distributions can be solved for, from a finite 
number of linear equations. However, we will give an alternate method 
for calculating the steady-state probability that the buffer content is i, 
which also involves a finite number of linear equations. In fact, by in- 
duction on i, we show how to calculate the elements of ft,-, i = 1,2, . . . , 
and hence m, . . . ,k,, from (7). 
We begin by defining the sets 

A, = \U ir) (m)\0 < m < i,l < r < k, m a proper state), (17) 

where the proper states satisfy the criteria of Theorem 7. The sets A, are 
finite, for fixed k, by Corollary 8. We also define the sets A-, which are 
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obtained from A, by deleting the single element U {k) {i,0,0, . . .), that 
is 

a; = A;~{t/(*>(;,o,o,...)}. (18) 

We will first show how to determine the elements of Aq, and thence the 
elements of fto. We will make use of 

Lemma 12: For k > 2, r = 1, . . . ,k — 1 and s = 1, . . . r, the quantities 

V { r s) (m) are linear combinations of the elements of Aq. 

Proof: From (9), (13), and (14), it follows that (S s -i(m;cr))o = 0. 

The result is then a consequence of the definitions in (15), (17), and 

(18).., 

If fe— 1, then Ao contains the single element L/ (1) (0,0, . . .), since 
meN k ~ r for a proper state, and hence the set Aq is empty. If k > 2, then 
Aq contains at least one element, namely, L/ (fe-1) (0,0, . . .). (If /e = 2, this 
might be the only element.) We now apply the reduction formula of 
Theorem 11 to each element of A£~ t/^-^O.O, . . .). But for m = and 
a a positive integer, (m — <rv r )o < 0, and hence L/ (r+1) (m — <ri/ r ) = 0. 
Hence, from Lemma 12, we obtain a system of homogeneous linear 
equations which contain as unknowns only the elements of Aq. Note that 
we have omitted the reduction formula for U (k ~ l) (0,0, . . .). Since there 
is one more unknown than the number of equations, we can solve for the 
elements of Ao to within a multiplicative constant. 

We are now in a position to determine the elements of fto. If k = 1, 
then, from the inequality in Theorem 3, fto contains just the single ele- 
ment L/(0,0, . . .) = kq, from (7), and kq is given by the formula in Prop- 
osition 1. If k > 2, then the elements of fto are given by Theorem 6' in 
terms of elements of Ao, since (m — apo)o < if mo = and a is a non- 
negative integer, and f/ (I) (m — ovq) = if (m — ovq)q < 0. Hence, the el- 
ements of Uo are determined to within a multiplicative constant, which 
is determined by (7), in terms of kq. The elements of Ao are now also 
completely determined. 

We next turn our attention to the calculation of the elements of A* and 
fij, for i = 1,2, .... First, however, we need 

Lemma 13: The assumption nkE(x) < 1 implies that p(0) > 0. 
Proof: E(x) = £"„, ip(i) > £,"=1 pd) = 1 ~ p(0). But, from (12), since 
«o 5^ 5^ «kt it follows that nh — 2, and hence E(x) < l k- ** 

We have shown how to determine the elements of Ao and fio. We will 
show how to determine the elements of A.} and ft,, for i = 1,2, ... . We 
first consider the special case k = l, and use induction on i. 

Theorem 14: For k = 1, if the elements of A * and ft,- are known, then the 

elements of A* + i ~ A* and ft, + i ~ ft,- may be determined. 

Proof: From (17) and (18), since k = 1 and meN k ~ r for a proper 

state, 

a? +1 ~a? = K/ (1) (M>,...)}. 
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But, from Theorem 6', 

t7(i,0,--.)-p(0)I/ (1) (»,0,...). 

Since p(0) > 0, by Lemma 13, and (7(i,0, . . .)e ft,-, this equation deter- 
mines U {l) (i,0, . . .)• Also, from Theorem 6', U(i + l,mi,0, . . .) is deter- 
mined for mi 5^ 0, if there are any such elements in ft I+ i, since a > and 
so (m - avo)o < i + 1. The remaining element of ft,+i ~ ft,- is 
U(i + 1,0, . . .), since meiV 1 for a proper state. But, from (9) and (10), 

U(i + 1,0, . . .) = t/(D(£,0, ...)- t Ufa - (7 - D + ,0, . . .), 

7=0 

so that the remaining element is determined. ** 

We now consider the general case, and establish 
Theorem 15: For k > 2, if the elements of A* are known, then the ele- 
ments of A- +1 ~ A* may be determined. 
Proof: From Theorem 11, 

i/»-»aa • • ■) = p(o)[u«Hi,o, ...) + vffifto, . . .)], 

which equation was omitted for i = 0. This equation determines 
U {k) (i,0, . . •), by Lemmas 12 and 13, since U {k ~ l) (i,0, . . .)e A*. Also, if 
m = i + 1, 1 < r < k - 1 and a = ak l m k - r > 0, then L/ (r) (m) is deter- 
mined by Theorem 11, since (m - av r )o < i + 1 for a > 0. The remaining 
elements of A- +1 ~ A* are U {r) (m) with m = i + 1, 1 ^ r < k -1 and m*_ r 
= 0. 
But from (11), 

t/c*-i)(i + i )0 , . . .) = [7<*>(i,0, ...)- t U^'Hy.i - 7 + 1,0, • • •), 

7 = 1 

where the summation is absent if i = 0. This determines 
(j(k-\)(i + i^o, . . .), and if k = 2 this is the only remaining element in A* +1 
~ A-. If k > 3, there still remain U {r) (m) with m = i + 1, 1 ^ r < k - 2 
and m/,_ r = 0, and from Theorem 11, 

C/< r >(m) = p(0)[a ,r+1) (m) + Vj l) (m)]. 

But we have just determined U^ k ~ l \i + 1,0, . . .), and so we know 

U lk ~ l) {i + 1 ™i> ■ • •) f° r m i - 0. Hence, from the above equation, by 

Lemma 12, we may determine L/ (/f_2) (m) with m = i + 1, and m 2 = 0. 

We then know (/ (/j_2) (m) with m = i + 1 and m 2 £ 0. By iteration of the 

above equation, we may determine any remaining elements of A-+i ~ 

A-. ., 

Lemma 16: For k > 2, the elements of ft, are determined by elements 

of A', for i = 1,2, .... 

Proof: The result follows from Theorem 6'. .. 

We have shown that the elements of A- and ft,-, for i = 1,2, . . . , may 
be determined explicitly, once the elements of A5, and ft , are known. 
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The determination of the elements of Aq, however, involves the solution 
of a homogeneous system of linear equations. 

V. A PARTICULAR CASE 

We now confine our attention to the particular case £„ = x n + x n -kj 
so that, from (2), 

ao = 1 = ak, oij = otherwise. (19) 

We are interested in determining the number of proper states m of U{m), 
and also of C/ (r) (ni), as defined by the criteria of Theorems 3 and 7. We 
show in the appendix that these criteria lead to a precise count of the 
number of nonzero U's and L/ (r) 's when (19) holds, if p(i) > 0, 
i = 0,1,2, .... 

We will make use of 

Lemma 17: For r = —1,0,1, . . . , and s = 1,2, . . . , the number of elements 
of neiV s-1 which satisfy the conditions Yii=o n i — r + U or 1=1, ... ,s 

is 

V s I \s-2l s!(r + s + 2)! 

Proof: We use induction on s. 

{s = 1) The number of no with < no ^ r + 1 is clearly r + 2 = 
F(r,l). 

(s -* s + 1) Now Y.i=o n i — r + I for / = 1 s + 1 implies that 

n {) < r + 1 and £'=i n; < r + I + 1 - no for I = 1, . . . ,s . Hence, 

P(r,s + 1) = L* P(r + 1 - n ,s) = ZPd,s) = I? ^(»», 

no=0 i=0 1=0 

from the inductive hypothesis. But, as may be verified, 

F(i,s) = F(i - l,s+ 1) - F(i - 2,s + 1). (21) 

Hence, 

ZF(i,s) = F(r,s+l), (22) 

«'=0 

since F{-2,s + 1) = 0. ., 

Corollary 18: For fixed mo and k, the number of proper states m of 
U(m) is F(nio — l,k), and the number of proper states mof U {r) {m) is 
F(mo + r — 1, k — r), for r = 1, . . . ,k. 

Proof: The results follow from (19), Theorems 3 and 7, and Lemma 17. 
Note that, for r = k, the only proper state of £/ (fe) (m) is (mo,0, . . .), since 
meN°, and we have F(m + k - 1,0) = 1. ,, 

From (16) and Corollary 18, it follows that the number of elements 
of fio is 
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Also, the number of elements of ft, ~ fto is 

|fl/|-|«o| = t F(m -l,k) = F(i-2,k + l) 
i{i + 2k+ 1)! 

= (94) 

(k + l)!(i + k + 1)! ' 

from (20) and (22). From (17) and Corollary 18, the number of elements 
of A, is 

I A,- 1 = t t F(m Q + r-l,k- r). (25) 

mn=0 r=\ 

But 

F( _ (r + ilr + a + 2)= dr±m±£±M . _, M m 

(r + ,s + 2)!.s! 
Therefore, from (21) and (26), we have 

F(m + r - l,k - r) = -F(-(m + r+ 3),m + k + 1) 
= -[F(-(m + r + 4),m + * + 2) - F(-(m + r + 5),m + ft + 2)]. 
Hence, if we sum and use (26), we obtain 

L F(m () + r- l,k-r) 

= -[F(-(m + b),m + k + 2) - F(-(m„ + ft + 5),m + ft + 2)] 

= F(m n + l,ft - 1) - F(m„ + ft + 1,-1) = F(m + l,ft-l). (27) 

From (21) and (25), it follows that 

|A,| = F(i,k) - F(-l,k). (28) 

Note, from (23), (24), and (28), that 

\Qi\ + | A, | = F(i - 2,k + 1) + F(i,k) = F(i - l,ft + 1), 

from (21). 

Of particular interest, for k > 2, is the number of equations required 
to determine the elements of A,', to within a multiplicative constant, 
namely |Aq| -1 = |A |-2, from (18). But, from (21) and (28), 

| A | = F(0,k) - F(-l,k) = F(l,k - 1) = ' :/ ,: 



(ft -l)!(ft +2)!" 
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The first few values of | A | - 2 and | ft | , as given by (23), are 

k 2 3 4 5 6 

|A |-2 17 26 88 295 

|flo| 2 5 14 42 132 

We also have the asymptotic result 

fc— |fl | 

VI. AN EXPLICIT EXAMPLE 

We here consider the example corresponding to k = 4 in (19), so that 
£„ = x n + x n - 4 . We will explicitly determine the elements of Q for this 
example. As discussed in Section IV, the reduction formula of Theorem 
11 is applied to each element of A5 ~ l/ (3) (0,0, . . .). Then the elements 
of fto are determined with the help of Theorem 6' and the normalization 
condition (7) with i = 0. 

From (17), (18), and Theorem 7, the elements of AS, with an obvious 
change of notation, are 

L/ffi im2 m 3 » /n 3 <l,m, + m3<2 > m 1 + m 2 + m 3 <3, (29) 
[/fi im2> m 2 <2,m 1 + /n 2 <3, (30) 

and 

U&v ™i^ 3 > (31) 

where mi, m 2 and m 3 are nonnegative integers. From (16) and Theorem 
3, the elements of % are 

C/omimmuO. ™* ^ l>m 2 + m 3 < 2,m x + m 2 + m :3 < 3. (32) 
But from Theorem 6', again with an obvious change of notation, 

From (7), the normalization condition is 

*0 = H^0mim2m.-)0 = Po 2_,^'0mim2m3> ^ ' 

where the summations are over the range of subscripts satisfying the 
inequalities in (29) and (32). 

We now apply the reduction formula of Theorem 11 to each element 
of A5 ~ U$,and note, from (12) and (19), that 

Mr = 1, r - 0,1,2,3. (35) 

From (9), (13), and (14), with m = (mo,mi,m 2 ,wi 3 ,0, . . .), we have 

m - 018*1 = ( m o _ wi3,mi,m2,0, . . .), (36) 
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and 

S (m;m 3 ) = (0,m - (m 3 - l) + ,m 1 ,m 2 ,0, . . .). (37) 

Hence, from (15) and (37), 

V{ l) (m) = U^ mo - (m3 - l)+tmi>m2 . (38) 

It follows from Theorem 1 1 that 

UomimzQ = Po(^0mim2 + U(to mim2 ), (39) 

and 

Uti&imal^PlUtiLim*, (40) 

since U l ?l m<m2 = 0. 

Similarly, with m = (mo,mi,m 2 ,0, . . .), 

m — m 2 v 2 — (mo ~~ m.2,mi,0, . . .), (41) 

Si(m;m 2 ) = (0,m - (m 2 - l) + ,mi,0, . . .), (42) 

and 

S (T 71 (m);m 2 ) = (0, 7 i - (m 2 - D + ,m - (ti - D + ,mi,0, . . .). (43) 

Hence, from (15), 

V 2 2) (m) = /7^ _ (m2 _ 1)+ , mi , (44) 

and 

V< 2 (m) = Y. t/(),7i-(m9-l)+,mo-(7i-lt+,mr (45) 

71>1 

It follows from Theorem 1 1 that 

U$ n0 = Po(U^ i + U& ) Omi ), (46) 

and, for m 2 ^ 0, 

L'Omim'i = P"J2 ( f^0,-(m2-l)+,mi "*" ^0,l-(m2-l)+,0,mi)- (47) 

Hence, 

^i-pitf/fflU + l/fflta.,) (48) 

and 

yffitf = P2t/ffiL r (49) 
Next, with m = (mo,mi,0, . . .), 

m- mip 3 = (m -m i,0, .. .), (50) 

S 2 (m;mi) = (0,m - (mi - l)+,0, . . .), (51) 

Si(T T1 (m);mi) = (0, 7 i - (mi - l) + ^ - (71 - D + ,0, . . .), (52) 
and 
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S (T 71 (T 72 (m));mi) 

= (0,7i - (mi - l) + ,72 " (7i " D + , ™o " (72 " D + ,0, • • •)• (53) 

Hence, from (15), 

vpw-ygU-cx-iH, (54) 

Vf(m)= E f/©i-( m i-i) + ,mo-(7i-D^ ( 55 > 

71>1 

and 

V^Hm) = L ^! 7 l-( m i-l)+,72-(71-D + .'"0-(72-l)+ • (56) 

71.72^1 

It follows from Theorem 11 that, for mi 5^ 0, 

U { 0mi = Pmi (t/S-(mi-l)+ + ^0?l-(mi-l)+,0 

+ E ^l)!7i-(mi-l)+,l-(7l-l) + .o)- (57) 
71 >1 / 

We now write out in full the nontrivial equations corresponding to (39), 
(40), (46), (48), (49), and (57), omitting terms which are identically zero. 
From (39) we have 

t/S&o = Po(t/» + t/l/oU l/ftfio = Po(U\$i + USU 

u$l = Pot^a, t/afco = po(t/{.To + t/ffio), 
ui¥io = po(^i ) i + ufflw, uffio = Poua, 

Ufllo = Po(tf|& + ^0020), Ufiio = P<Mi\, 

Uffltjo-PoUfflh (58) 

and from (40) we have 

Utiln = Pi^ltto, t/i.011 = PiUffln. t/ffln = Pitffik 

tfffii = PiUjfti, t/^01 = PiCflfto- (59) 

Next, from (46) we have 

U&a = Po(Uf» + ^Voo), U&o = Po(l/ii ) + Wffln), 

Ufa = Pot/ff, Uf8. = Pot*, (60) 

from (48) we have 

Uffi-Pi(U»+E/fiU 
l/ffl = Pl (Uffl + UfiU Uffi = Pi^, (61) 

and from (49) we have 

tfffi. = P2^oU Uffi = PiUtik. (62) 
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Finally, from (57) we have 

U9 = PiiUS + u$ Q + t/ffio + L/,Woo), 
U9 - P2( Oft + t/fflo + Woo), WlJ - PslWo. (63) 

We may eliminate the 13 nonzero quantities C/^ims an( ^ ^m, from 
(58) to (63), and solve for the 14 nonzero quantities Utfmimoma to within 
a multiplicative constant. It is found that 

l/fi&o = an, Ufthi = Pido, U$ n = pfao, 

U&U = Pl^O, £/|)020= P0P2«0, t/0300 = PoP30o, 

Uffio = Uffio = ^0201 - PoPiP2«o, (64) 

and 

C/feVo = P i Aa , t/oVoi = P f Aa , 
t/oVio = P?(l + PoPi )Aa , ^Voo = PoP2(l + PoPi)Aa 0) 

C/JVoo = Pi[l + Po(Pi + P0P2HI + p pi)]Aa , (65) 

where 

A = {1 - p Pi[l + Po 2 (Pi 2 + P0P2XI + PoPi)])" -1 . (66) 

The constant cto is determined by the normalization condition (34). 
These results are consistent with those derived by a different 
method. 3 

APPENDIX 

We show here that in the particular case corresponding to (19), the 
criteria of Theorems 3 and 7 lead to a precise count of the number of 
nonzero (/'s and U {r), s if p(i) > 0, i = 0,1,2, We first prove 

Theorem 19: If (19) holds, p(i) > 0, i = 0,1,2, ... , me N k and 

£ m /t _ l+1 < m + I - 1, /=l,...,/z, (67) 

i/zen C/(m) ^ 0. 

Proof: From (4), (5), and (19), it follows that 

B„ = {b n ,x„-k, ■ ■ ■ ,x n _i,0, • ■ ■)■ (68) 

It was shown 2 that the irreducible Markov chain, with state space con- 
sisting of those states which communicate with (0,0, . . .), is positive re- 
current. Moreover, it was also shown that, in the present notation, the 
state (j'o,0, . . .) communicates with the state (0,0, . . .), where io is a 
positive integer. Hence, with probability 1, the state (i'o,0, . . .) occurs 
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infinitely often. We now assume that & n -k is given by 

h 

b n -k = m + k - Y. m k-i+i, x n -2k+r-i = 0, r = 1,. . . ,k. 

(69) 
Also, with positive probability, since p(i) > 0, i = 0,1,2, . . ., 

Xn-k+r-i = rn r , r=l, ...,/e. (70) 

We will show that (67), (69), and (70) imply that b n = m , and hence, 
from (6), that L/(m) ^ 0. 

We first show, by induction, that 

b n - k+r = m + k-r- fm k - i+1 > 1, r = 0, . . . ,k - 1. (71) 
;=i 

This is true for r = 0, from (67) and (69). 

(r -*• r + 1) We consider r = 0, . . . ,k — 2, for k > 2. Since £„ = 
x n + x n - k , it follows from (1), (69), and (70) that 

bn-k+r+l = (bn-k+r ~ D + + ™r+l 

= b n -k+r — 1 + m r +i 
= m + k-(r+l)- £ l m k - i+1 >l, (72) 

i=l 

from (67). This completes the inductive proof of (71). Finally, with the 
help of (71), we obtain 

b n = (b n -i - l.) + + m k = b n -i - 1 + m k = m . *, 

We now prove 

Theorem 20: Suppose that (19) holds and p(i) > 0, i- 0,1,2 Also 

suppose, for k > 1 and r = 1, . . . ,k, that m e N k ~ r and, for k > 2 and 
r ■ 1, . . . ,k - 1, that 

£ m*_,_ r+1 < m + r + / - 1, / = 1, . . . ,k - r. (73) 

Then U^(m) * 0. 

Proof: Use induction on r. We note, from (6), (10), and (11), that C/ (r) (m) 
>0, r = l,...,k. 
(r = 1) Let 

m = T mo+1 (m) = (m + 1,0,^1, . . .), (74) 

from (9). We will show that U(m) ^ 0, which implies that £/ (1) (m) ^ 0, 
from (10). If k = 1, then rh = (m + 1,0,0, . . .), hence m eiV 1 and 
= mj < rho = m Q + 1. It follows from Theorem 19 that U{m) ^O.Uk 
> 2, then rh e N k since m e N k ~\ and, from (73), 
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I 
£ rhk-i+i < rho + I - 1, J = 1, . . . ,k - 1, 

A: k-l 

E ^ft-j+i = L mk-i+i <m + k-2<m + k-l. 

It follows from Theorem 19 that U(m) ^ 0. 

(r - 1 -*■ r) We consider r = 2, . . . t k — 1, for k > 3. Then, from 
(74), m e N h ~ r implies that m eN k ~ r+1 . Also, from (73), 

/ 

£ rhk-i-r+2 < rfio + r + I - 2, I = 1, . . . ,k - r, 
i=\ 

k-r+l k-r 

£ /n/e- ( -- r+ 2 = E ^/o-/-r+2 <mo + fc-2<m + fe-l. 
1=1 (=1 

It follows from the inductive hypothesis that U ir ~ l) M & 0. Hence, from 
(11), LM'Hm) * 0. 

(k) m eiV°, for k > 2, implies that rh eN 1 and = m, < 
m + fe - 1 - m + k. Hence, t7<*-«(ih) ^ and, from (11), £/ ( *>(m) ^ 
0.,, 
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